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Abstract 

Human movement has been studied for decades and dynamic laws 
of motion that are common to all humans have been derived. Yet, 
every individual moves differently from everyone else (faster/slower, 
harder/smoother etc). We propose here an index of such variability, 
namely an individual motor signature (IMS) able to capture the subtle 
differences in the way each of us moves. We show that the IMS of a per¬ 
son is time-invariant and that it significantly differs from those of other 
individuals. This allows us to quantify the dynamic similarity, a mea¬ 
sure of rapport between dynamics of different individuals’ movements, 
and demonstrate that it facilitates coordination during interaction. We 
use our measure to confirm a key prediction of the theory of similarity 
that coordination between two individuals performing a joint-action 
task is higher if their motions share similar dynamic features. Fur¬ 
thermore, we use a virtual avatar driven by an interactive cognitive 
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architecture based on feedback control theory to explore the effects of 
different kinematic features of the avatar motion on the coordination 
with human players. 


1 Introduction 

Humans often need to perform joint tasks and coordinate their movement 
|T]. Their motion can be studied and classified by means of some common 
generalised movement laws that define a “human-like” way of move¬ 

ment HIE]. However, every individual moves following a specific personal 
style characterised by unique kinematic features. An open problem is to find 
methods that capture such features and identify different individuals from 
the way they move. This is key to show that individuals moving in similar 
ways exhibit higher levels of synchronisation when performing joint tasks. 

Specifically, studies of interpersonal interaction show that people prefer 
to interact with others who are similar to themselves mu- Moreover, it has 
been shown that social movement coordination between interacting people 
could be used to assess their mutual rapport piiniiii]. These observations 
have led to the development of a theory of similarity which predicts that 
the level of synchronisation in joint actions is enhanced if the participants 
are similar in terms of morphology and movement dynamics and are willing 
to match their behaviours [m la Ej. Despite previous attempts in the 
literature m, the theory of similarity have not been tested in controlled 
experiments. 

In this paper we demonstrate existence of a time-invariant individual 
motor signature, and show how it can be used to study socio-motor co¬ 
ordination. The notion of individual motor signature has its roots in the 
concept of frequency detuning (eigenfrequency difference) between two in¬ 
teracting humans and the phenomenon of the so-called maintenance ten¬ 
dency [miiTiiisi. It has been further extended to intrinsic dynamics that 
is observed in form of individual preferred coordination modes (behavioural 
repertoire) exhibited during intra-personal coordination task |191120] . We 
focus here on identifying a more general measure able to capture some key 
kinematic features of the motion of each individual and discriminate among 
different people. Using our measure, we are able to introduce a metric to 
assess the dynamic similarity between the movement of different humans 
and show that it helps to predict the level of coordination in an interactive 
joint-action task. 

We demonstrate the theory by using a virtual avatar playing the “mirror 
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game”, an activity where two players are asked to imitate each other’s move¬ 
ments, and which has recently been established as a paradigm for studying 
interpersonal movement dynamics (see [211 122] and references therein). Our 
evidence shows that similarity between the preferred motion of each player 
enhances the synchronisation level measured during the interaction. 

More generally, our results introduce dynamic similarity as an important, 
complementary to qualitative measures of affiliation, factor affecting joint 
actions and enhancing coordination between socially interacting people. 

2 Methods 

The results presented in this paper are based on the analysis of data collected 
in three different experimental scenarios (each with different group of par¬ 
ticipants), performed in the course of the research project AlterEgo funded 
by the European Union |34j . In Scenario 1 we only collected solo movements 
of the participants; in Scenario 2 we collected data from humans playing the 
mirror game in a solo condition and in dyads where they have to track each 
other’s movements, in Scenario 3 we collected data from human participants 
playing solo and interacting with a virtual player (VP). Data collected in 
Scenario 1 were used to establish existence of the individual motor signature. 
Data collected in Scenarios 2 and 3 is used to demonstrate that coordina¬ 
tion during an interactive task depends on the dynamic similarity between 
participants. In particular, we use Solo data collected in Scenarios 2 and 3 
to measure dynamic similarity between interacting participants. 

2.1 Experimental Setups and Data Collection 

In Scenario 1, participants were asked to perform three solo sessions, each 
one separated by at least one week. Each participant was asked to sit com¬ 
fortably on a chair and create interesting motion by moving her/his preferred 
hand above a leap motion® sensor [35] connected to a laptop. The move¬ 
ment of a participant was visualised on the screen of the laptop as a dot. 
Participants were given the following instruction: “Play the game on your 
own, create interesting motions and enjoy playing”. Due to the nature of 
the experimental set-up, the position was recorded in arbitrary units. At 
each session, a participant was required to perform three solo rounds, each 
one lasting 60 seconds. In total, we recorded nine position time series for 
each of the 15 participants. 

In Scenario 2 participants sat comfortably opposite each other. Two 
horizontal strings (length 1800mm) were mounted at eye level, centrally 
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between the participants; on each string a ball with a small handle was 
mounted. Participants were instructed to move these balls left and right 
along the strings during the experiment. The movements of each participant 
were captured using reflecting marker placed on the ball with infrared MX13 
cameras (Vicon-Nexus, Oxford Metrics Ltd.) at a sampling rate of 100 Hz. 
Data was collected from 8 dyads (16 participants in total). All participants 
were right handed. Participants were given the following instructions; 

• Solo Condition. Participants were given the same instruction as in 
Scenario 1. Participants had no view of their partner. 

• Leader-Follower Condition. “This is a collaborative round whose pur¬ 
pose is to enjoy creating synchronised motion. Participant 1, lead 
the movement. Participant 2 try to follow your partner’s movement.” 
Two versions of this condition were played to allow both participants 
to lead and to follow. 

• Joint Improvisation Condition. “In this collaborative round there is 
no leader and no follower. Let these 2 roles emerge naturally, imitate 
each other and create synchronised and interesting motions. Enjoy 
playing together.” 

In Scenario 3, human players were asked to play with the VP described 
in [MUST]. Participants were standing in front of an LCD display showing 
the virtual player. A horizontal string (length 1800mm) was mounted in 
front of the participant. As in Scenario 2, a ball with a small handle was 
mounted on the string. Participants were instructed to move the ball left 
and right along the string. On the screen facing the human player, a ball, 
which is controlled by the VP, is also shown to move along a string. The 
movement of each participant was recorded with a single wide-angle camera. 
The sampling rate was not uniform and averaged around 40Hz. 

The virtual player was driven by an interactive cognitive architecture 
(ICA) which used a pre-recorded reference motion trajectory (Ref) and an 
adaptive feedback control algorithm to generate the VP’s movement, while 
being influenced by the follower’s performance (see [MIEZ! for further de¬ 
tails). It is important to note that the ICA does not simply replay pre¬ 
recorded time-series as in [29], but uses them as preference signal in order 
to generate the output trajectory for the VP. This allows for a real-time 
movement behaviour matching between human and virtual players, which 
is a fundamental part of the interaction in the mirror game. For instance, 
if the follower stops tracking the movement of the leader, it is appropriate 
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for the leader, as done by the ICA driving the virtual player, to adjust its 
movement and guide the follower in order to encourage the interaction. In 
Scenario 3 the interactive cognitive architecture driving the VP was fed with 
pre-recorded position time series based on solo trials of the human partic¬ 
ipant playing with it. More specifically, to control similarity between the 
solo motion and reference trajectory the pre-recorded solo trajectory of the 
player was superimposed with a 2.5Hz sinusoidal signal with time varying 
amplitude defined as 1/3 of the corresponding normalised velocity of the 
solo trajectory. Further analysis of the VP’s performance can be found in 
SI appendix. Data was collected from 51 individuals playing the mirror 
game with the virtual player. The data set of each participant contained 
participant’s and VP’s positions for each of the following rounds: 4 solo (one 
minute) rounds (without VP) and 12 rounds (30 seconds) where the human 
participant played as a follower. 

2.2 Data processing 

The collected data was pre-processed in Matlab®. When necessary we used 
interpolation with shape-preserving piecewise cubic interpolation and filter¬ 
ing with a zero-phase forward and reverse digital 2nd order lowpass (lOHz 
cut-off) Butterworth filter. The position time series were then used to nu¬ 
merically estimate their corresponding velocity time-series. To differentiate 
position time-series we used a fourth-order finite difference scheme. We cut 
out the hrst and last 2 seconds of the signal. Furthermore, we limited ve¬ 
locities to 3.5 [a.u./s] in the experimental Scenario 1 and to 2.7 [m/s] in the 
experimental Scenarios 2 and 3 (higher velocities were considered as results 
of noise in the collected data). To estimate the probability density function 
(PDF) of the player’s velocity we use normalised histogram of the velocity 
time series with 101 equally distant bins between -2.7 and 2.7 [m/s] (or -3.5 
and 3.5 [a.u./s] in Scenario 1). Further details about data processing can be 
found in SI appendix. 

In order to quantify similarity between PDFs of player’s velocity we 
use Earth’s movers distance (EMD) that is an established tool in pattern 
recognition applications |26j . Intuitively, the EMD measures how much work 
is required to transform a ’pile of earth’ into another; each ’pile of earth’ 
representing a histogram. In the case of univariate probability distributions 
the EMD is given by the area of the difference between their cumulative 
distribution functions. More details can be found in Appendix A. 

Distances between PDFs are then analysed by means of Multidimen¬ 
sional scaling (MDS). MDS is a well established tool in data visualisation 
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and data mining [28]. It allows to reduce dimensionality of the data and 
visualise relations between the objects under investigation while preserving 
as much information as possible. Since the EMD is a metric in the space 
of the PDFs of velocity time series we use classical MDS in the form imple¬ 
mented in Matlab®. Description of the MDS algorithm and discussion of 
relation between MDS and principal component analysis can be found in SI 
appendix. 

In order to quantify temporal correspondence (level of coordination) be¬ 
tween players we introduce the relative position error (RPE). The RPE is a 
measure of temporal correspondence between complex, non-periodic, coordi¬ 
nated movements which is based on the natural notion of a follower lagging 
behind the leader when tracking her/his motion. In particular, RPE is a 
measure of position mismatch between a leader and a follower capturing how 
well the follower tracks the leader’s movement. See Appendix C for further 
details. Discussion of the advantages of using the RPE over the relative 
phase based on the Hilbert transform can be found in Sections 9 and 10 of 
the SI appendix. 

3 Results 

We show the existence of an individual motor signature (IMS) for each 
player, defined as a time-invariant tractable characteristic of her/his move¬ 
ment. We develop a framework allowing us to demonstrate that characteris¬ 
tics of the solo movement in the mirror game are time-persistent and differ 
significantly between participants. In the proposed framework we employ 
velocity profiles (PDFs of the velocity time series) to reveal that the rapport 
(similarity) between individual motor signatures enhances synchronisation 
of movement between participants in joint action. Finally, we demonstrate 
that a virtual player driven by a novel interactive cognitive architecture 
[MIETI can be used to study interpersonal interaction in a ’mirror game’ 
between human and virtual players. 

3.1 Existence of an Individual Motor Signature 

In this section we study solo mirror game recordings collected in the experi¬ 
mental Scenario 1 in order to investigate the existence of an individual motor 
signature. In particular we demonstrate that: 1) the movement character¬ 
istics of each individual persist in time, and 2) that they differ significantly 
between individuals. 
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Scenario 1 


Scenario 3 



Figure 1: Individual motor signature in the similarity space computed with 
MDS from distances between velocity profiles. (A) For 15 different partic¬ 
ipants from solo mirror game recordings in Scenario 1, on three different 
days with at least one week break between recording rounds. (B) For 56 
solo trials of 14 participants from solo mirror game recordings in Scenario 
3 (for the sake of clarity data for only 14 out of 51 participants is shown). 
Each ellipse corresponds to a different participant. Small dots correspond to 
individual solo recordings. Each cross at the centre of an ellipse corresponds 
to the average of the small dots’ positions. Each ellipse indicates 0.7 mass 
of bivariate normal distribution fitted to the small dots (see SI appendix for 
further details). 


To this end, we analyse velocity profiles which characterise motion in 
the mirror game on the time-scale of a complete experimental trial. We 
use the Earth Mover’s Distance (EMD) to assess distances between velocity 
prohles of different individuals. We then represent them as points in the 
similarity space, that is an abstract geometric space constructed by means 
of multidimensional scaling (MDS) [28] that provides a visual representation 
of the pattern of proximities (i.e., similarities or distances) among a set of 
objects. As a result we obtain clusters of points corresponding to solo trials 
of individual participants. In order to measure separation between clusters 
of points in the similarity space we measure overlap uj between ellipses that 
encircle them, with w = 0 meaning that the ellipses do not overlap at all and 
a; = 1 meaning complete overlap (see SI appendix for further details about 
ellipses and overlap). 

Figure depicts velocity profiles from solo trials presented as elements 
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of the similarity space. Figure shows data for 15 different participants 
from experimental Scenario 1 and Fig. shows representative data of 14 
out of 51 participant from experimental Scenario 3. We note that, in the 
experimental Scenario 3, players had larger range of movement and all the 
solo trials of individual players were recorded on a single day. Each dot in 
Fig.[T] corresponds to a velocity profile from a single trial. The dots cor¬ 
responding to different individuals are encircled by ellipses. Importantly, 
Fig.[T]A demonstrates clustering of the dots for different participants col¬ 
lected on three different days. Such clustering indicates time-invariance of 
the individual motor signature. The variability between radii of the ellipses 
associated with different individuals signify that the individual motor sig¬ 
nature of some individuals is more variable than the others. 

Furthermore both data sets presented in Fig. [^demonstrate a good sepa¬ 
ration of the ellipses corresponding to individual participants, with a median 
overlap lo between 15 ellipses in A equal to 0.02 and between ellipses of all 
51 participants from experimental Scenario 3 equal to 0.05. Interestingly, in 
the data from experimental Scenario 1 there are 45 out of 105 pairs of ellipses 
that do not overlap at all, meaning that in almost half of the cases two par¬ 
ticipants can be explicitly distinguished just by observing their solo motion. 
The same holds true for 418 out of 1275 pairs of ellipses from experimen¬ 
tal Scenario 3. Comparison of separation between individuals achieved by 
means of the velocity profiles and using individual characteristic of motion 
suggested in [211 [221 [29] can be found in the SI appendix. 

The physical interpretation of the two principal dimensions of the simi¬ 
larity space constitutes a further insight gained from our analysis. In par¬ 
ticular, our analysis reveals that the coordinate x of the movement repre¬ 
sentation in the similarity space, which corresponds to the first principal 
dimension given by the MDS, is correlated with the absolute average veloc¬ 
ity of the motion. In addition the y coordinate of the representation of each 
time series in the similarity space, which corresponds to the second princi¬ 
pal dimension from the MDS, is correlated with the kurtosis of a velocity 
segment ED [22], a part of the velocity time-series between two consecu¬ 
tive times of zero velocity. That is it informs us on the ratio of high and 
low velocities in the motion. For further details about interpretation of the 
dimensions in the similarity space see Appendix B. 

In summary, individual motor signatures identify each different partic¬ 
ipant and can be used effectively to measure dynamic similarity between 
them. More importantly, they provide a comprehensive and holistic descrip¬ 
tion of the kinematic characteristics and variability of human movement. 


8 


Leader 1 


Leader 2 


Joint Improvisation 



Figure 2; Interaction between two players in different experimental condi¬ 
tions visualised in the similarity space. Ellipses encircle points corresponding 
to velocity profiles in solo (SI and S2; light grey), leader (LI and L2; dark 
grey), follower (FI and F2; dark grey) and joint improvisation (JIl and JI2; 
dark grey) rounds. Each row depicts data for a different dyad. In column 
1 player 1 was a leader, in column 2 player 2 was a leader and in column 
3 participants played in joint improvisation condition, x axis has the same 
range in all panels, y axis is rescaled for clarity of presentation. 


3.2 Behavioural plasticity during social interaction 

Using the concepts of individual motor signature and similarity space we are 
able to demonstrate behavioural plasticity during social interaction. Specif¬ 
ically by behavioural plasticity we mean that in order to cooperate people 
are willing, to a different degree, to disregard their individual preferences. 
Indeed, by comparing positions in the similarity space of the velocity profiles 
from solo and cooperative trials (leader follower and joint-improvisation), we 
find that some people are more inclined to adjust their kinematic character- 
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istics when interacting with others in the mirror game. Figure 2 shows three 
representative examples of the behavioural plasticity detected during the ex¬ 
perimental Scenario 2. In Fig. 2A1 and A2 we depict consistent behaviour 
of the leader and follower independently of which player is the designated 
leader. In Fig. 2B1 and B2 we notice that dynamics of movement differs 
significantly depending on who is leading. In Fig. 2C1 and C2 we illustrate 
a player (S2) that dominates the interaction in terms of movement charac¬ 
teristics. Furthermore, Fig. 2A3-C3 show that motion dynamics in the joint 
improvisation condition is clearly different compared to the leader-follower 
condition in agreement with recently published results [21] . Visualisation of 
the interactions for all the 8 dyads from the experimental scenario 2 can be 
found in SI appendix Supplementary Figure 4. Taken together the above ob¬ 
servations suggest that the behavioural plasticity might be regulable rather 
than fixed and could be modulated in order to enhance social competence. 
Fig. 2 showcases a new technique that could be useful in studies of mutual 
rapport, affiliation and leadership emergence. However, rigorous analysis of 
the complex relation between individual motor signatures and movements 
during cooperative conditions is beyond the scope of this paper. 

3.3 Dynamic similarity enhances coordination in joint action 

Having defined suitable measures, we next analyse the effects of the dynamic 
similarity on the temporal correspondence in two different experimental sce¬ 
narios: the former where two humans play the mirror game (Scenario 2) and 
the latter where a human is asked to play the game with a virtual player 
(Scenario 3). In particular, we measure the temporal correspondence be¬ 
tween players in the leader-follower condition of the mirror game and study 
systematically if and how it is related to the difference between their in¬ 
dividual motor signatures. In order to demonstrate that dynamic similar¬ 
ity facilitates coordination between players in the mirror game we seek to 
find a correlation between dynamic similarity, as quantified by means of 
the distance between velocity prohles in the similarity space, and temporal 
correspondence measured by the relative position error (RPE). For further 
details about the definition and interpretation of the RPE see Appendix C. 
Eig. [^-C illustrate the steps we take in our analysis detailed in the hgure 
legend. 

The correlation between temporal correspondence and dynamic similar¬ 
ity observed in the data from human-human interaction collected in the 
experimental Scenario 2 is shown in Fig. |4]4. For each dyad we calculate 
nine values for the distance between the players signatures Sl and Sp (all 
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Solo Profile 1 Profile 2 



velocity [m/s] velocity [m/s] 


Leader 1 - Follower 2 



Figure 3: First we compute dynamic similarity between two players. In 
panel A1 we show the solo movements of two participants who later played 
together in the leader-follower condition. Panels A2 and A3 depict velocity 
prohles that represent individual motor signatures of the two players (Sa 2 
and Syia) corresponding to the positions time series presented in panel Al. 
The EMD(S/i 2 )Syi 3 ) = 0.0303 between the histograms in panels A2 and A3 
quantihes dynamic similarity between the two players. Then we measure 
temporal correspondence between their movements when they play together 
in the leader-follower condition. Panel B illustrates position traces of the 
participants from panel A when they play together as a leader (black) and 
follower (grey). Panel C shows the RPE between leader and follower tra¬ 
jectories presented in panel B. The mean value and the standard deviation 
of the RPE are respectively /iRPE(L^ 2 )FA 3 ) = 0.05 and (TRPE(L^ 2 )Fyi 3 ) = 
0.05. 


the combinations between three solo trials for each player) and six values 
for the mean relative position error between the leader (L) and the follower 
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Figure 4: Panel A shows correlation between EMD(Sl, Sp) and RPE(L, E) 
computed for all individual leader-follower trials in 8 dyads from Scenario 2. 
Panels B depicts the dependence of RPE(Lvp, Eh) between the VP leading 
the human participant on EMD(Ref, S) between the reference trajectory and 
the participant’s solo movement (Scenario 3). Each black dot corresponds 
to a single leader-follower trial. Grey lines are presented only for illustrative 
purposes. Spearman’s p coefficients are equal to: pA = 0.3907 [ppA = 
0.0066), pb = 0.2224 {ppB < 1-Oe — 5); Pearson’s coefficients are equal 
to: R\ = 0.3701, {pb?a = 0.0105), = 0.2343 {pbpb < l-Oe - 5). 

(F) (three trials with player 1 as a leader and three trials with player 2 as 
a leader); Spearman’s rank correlation |32[ I43j between EMD distance and 
relative position error was computed to be /7=0.3907 (pp=0.0066). We re¬ 
moved a single outlier with RPE>0.2 (the correlation including the outlier 
was stronger). We use Spearman’s rank correlation because our data is not 
normally distributed. 

We further control the identified correlation for two confounding factors. 
First, we expect that a faster leader is more difficult to follow than a slower 
one, hence we control the identified correlation for the mean absolute ve¬ 
locity of the leader /r|VL|. Second, we expect that it is easier for a follower 
who prefers fast motions to track movement of a leader who prefers to move 
slowly, than it is for a follower who prefers slow motions to track a leader 
who prefers to move fast. Therefore we control the identified correlation 
for the difference between mean absolute velocities of the solo movements 
of the leader and the follower p\Vsl\ — which is proportional to 

the difference between their x coordinates (see Appendix B). Partial and 
adjusted correlation coefficients are computed in Matlab® using functions 
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partialcorr and partialcorri. As expected, we found the mean RPE be¬ 
tween leader (L) and follower (F) to be strongly correlated with both ^j\Vi\ 
and ^i\VsL\ — ^A^SF\■ Nonetheless, the relation between mean RPE(L, F) 
and EMD(Sl, Sf) controlled for the confounding factors remained statisti¬ 
cally significant; partial Spearman’s rank correlation controlled for /i| Vl| was 
computed to be p=0.3466 (pp=0.0183); partial Spearman’s rank correlation 
controlled for ^j\Vsl\ — ^A^SF\ was computed to be p=0.5025 (pp=0.0003); 
Spearman’s rank correlation adjusted for both, ^\Vl\ and ^j\Vsl\ — iA^sf\-, 
was computed to be /3=0.4697 (pp=0.0011). 

We confirm our observations by also analysing data from the experimen¬ 
tal Scenario 3, where a virtual player leads a human follower. In particular, 
we compute correlations between the similarity of the two players’ motions 
(evaluated in terms of the average distance between the velocity profile of 
the VP reference trajectory (Ref) and the four velocity profiles of the solo 
motion of the human player) and their temporal correspondence. Fig. 
demonstrates that temporal correspondence depends on the dynamic sim¬ 
ilarity between the reference trajectory of the virtual player and partici¬ 
pant’s solo movement. In particular, we find that mean of the RPE between 
leader (Lyp) and follower (Fp) increases with the distance between their 
signatures. This finding affirms that dynamic similarity between reference 
trajectory and player’s solo movements facilitates coordination between the 
VP leader and human (H) follower; the Spearman’s rank correlation was 
computed to be /9=0.2224 {pp < le-05). 

As in the case of the data from the experimental Scenario 2 we controlled 
the correlation for the two confounding factors and found that the partial 
correlation controlled for fj,\VLyp \ is significant with partial Spearman’s rank 
coefficient equal to p=0.1863 {pp < l.Oe-05). On the other hand, the correla¬ 
tion disappears when we control it for pi\VRef \ — ^A^SF\■ However, since the 
reference trajectories of the VP were simply made faster by adding 2.5Hz 
sine signal, i.e. \ > pi\VsH\-, this is exactly what should be expected. 

In other words, our analysis of the data from the experimental Scenario 3 
demonstrates the effect of the dynamic similarity in the special case when it 
can be simplified to a difference between the preferred solo velocities of the 
participants. It is important to note that this observation is only possible 
due to our experimental set-up allowing for an interaction between a human 
and a virtual player using as a reference trajectory one of the human player’s 
solo trajectories post-processed as described in the Methods Section above. 

In summary, we show that a small distance between individual veloc¬ 
ity profiles of the leader and the follower, indicating that they have similar 
movement dynamics, results in higher levels of coordination than those ob- 
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served in dyads in which the distance between participants’ individual motor 
signatures is larger. In so doing, we demonstrate that dynamic similarity 
affects the level of coordination in joint human movement interactions. Our 
results are a step forward towards confirming a prediction of the theory of 
similarity, namely that dynamic similarity enhances inter-human interac¬ 
tion. 

4 Discussion and Conclusions 

In this paper we introduced the notion of dynamic similarity in the mirror 
game [22] and demonstrated the existence of an individual motor signature 
in human players. We then showed that the synchronisation level between 
the players is affected by their dynamic similarity. In particular, we proposed 
the use of velocity profiles, defined by the probability density functions of 
velocity time series recorded in the mirror game, as motor signatures. We 
used the earth’s mover distance and multidimensional scaling to show that 
velocity profiles of the solo movement have characteristics of individual mo¬ 
tor signatures, i.e. they are stable over time and differ significantly between 
individual players. In this way we revealed time-persistent, individual mo¬ 
tor properties that could be detected in complicated, non-periodic motion 
observed in the mirror game, as suggested in [2T]. Notably we extended 
the notion of motor signature beyond the frequency content of a periodic 
motion [I6l[171[l8l|33|. Since the individual motor signature can be readily 
recorded by means of a cheap off-the-shelf experimental set-up, we believe 
that it could become an integral part of studies investigating interpersonal 
interaction. 

We introduced the evaluation of the distance between velocity profiles 
as a method of quantifying dynamic similarity between players’ motion in 
the mirror game and used the relative position error to measure their tem¬ 
poral correspondence. Our key finding supports a central predictions of the 
theory of similarity, specifically that dynamic similarity of participants’ solo 
motions enhances their coordination level [181139] . 

Our work complements research on individuality and interactions in an¬ 
imal groups in two ways [53]. First, our study involves direct and inten¬ 
tional coordination that is typical for human-human interactions. Such in¬ 
teractions, in general, allow for investigation of an intentionally designated 
leader’s behaviour and are fundamentally different compared to spontaneous 
or unintentional coordination amongst individuals and/or groups of animals. 
Second, the overlap between our results and the findings reported in [53] rep- 
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resents a promising avenue for future work on the extension of animal models 
to inter-personal interactions. 

Finally, the methods we have introduced and the data we have collected 
establish the use of a virtual player m, driven by an interactive cognitive 
architecture, as an effective tool for studying joint actions in the mirror 
game. Importantly, the advantages of using an interactive cognitive archi¬ 
tecture based on feedback control to drive the avatar is that bi-directional 
coupling is maintained during the mirror game and that it allows control of 
the interaction between human and avatar in two ways, by choosing refer¬ 
ence trajectories and by changing the bi-directional coupling parameters of 
the interactive cognitive architecture. Such level of control in a socio-motor 
coordination task could be used in applications that aim to reinforce social 
bonding in joint-action tasks [Mill]. 

In summary: 

• We introduce quantitative measures and analyse dynamic properties 
of complex aperiodic movements that characterise human socio-motor 
interactions. 

• We demonstrate the existence of an individual motor signature for each 
player, defined as a time-invariant tractable characteristic of her/his 
movement and reveal that the rapport (similarity) between individual 
motor signatures enhances coordination of movement between different 
players. 

• We introduce a novel interactive cognitive architecture able to drive 
a virtual player to play the game and employ it as a model of inter¬ 
personal interaction in the mirror game between human and virtual 
players. 
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Appendix A 

Earth’s movers distance 

Mathematically the Earth’s movers distance (EMD) is a special case of 
Wasserstein distance |26| . It is a solution of the optimal transportation 
problem [38j and is an established tool in image analysis and pattern recog¬ 
nition applications [55]. Eor univariate PDEs it can be expressed in a closed 
form as the area between their corresponding cumulative distribution func¬ 
tions [25] : 

EMD[PDFi{z),PDF 2 {z))= [ \CDFi{z)-CDF 2 iz)\dz (1) 

Jz 

Here, PDFi and PDF 2 are two probability density functions with support 
in set Z, CDFi and CDF 2 are their respective cumulative distribution func¬ 
tions. We note that EMD is a well-defined metric in the space of PDEs as 
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velocity [m/s] velocity [m/s] 


Figure 5: Panel A shows a velocity profile - histogram (/i^; black) of the 
velocity time series. Panel B shows histogram {hs] grey) of a random vari¬ 
able generated with distribution of type-1 from the Pearson system. Both 
samples have /r = —0.01, a = 0.54, s = —0.04 and k = 1.82 where /x is the 
mean, a is the standard deviation, s is the skewness and k is the kurtosis. 
Panel C shows cumulative density functions of the distribution from panel A 
in black and from panel B in grey. The light grey shading indicates the area 
of difference between the CDFs, i.e. the Earth’s movers distance between 
the two distributions, EMD{hA, hs) = 0 . 02 . 


it satishes the following conditions: 

Positive definiteness: d{xi,xi) = 0, xi 7 ^ X 2 ^ d{xi,X 2 ) > 0, 
Symmetry: d{xi,X 2 ) = d{x 2 ,xi), 

Triangle inequality: d{xi,X 2 ) < d{xi,X 3 ) + d{x 2 -,x^). 

These conditions express intuitive notions about the concept of distance. 
For example, that the distance between distinct points is positive and the 
distance from x to y is the same as the distance from y to x. The triangle 
inequality means that the distance from x to z via y is at least as great as 
from X to z directly. Furthermore, EMD is non-parametric and quantifies 
partial matches. Hence, it allows to compare PDEs rather than their se¬ 
lected moments. This represents a significant advantage of our analysis in 
comparison to using selected moments, which are not sufficient to uniquely 
parameterise a PDE. We note that a bounded PDE is uniquely determined 
by its moments of all orders (0 to inhnity) |42) . 

Eigure shows an example of two histograms with the same estimates 
of the hrst four moments and demonstrates that by using the EMD we 
can distinguish them. The histogram in panel A is a velocity profile {Ha) 


17 
































computed for a time series in our data, while panel B shows a histogram 
{hs) of a random variable generated using distribution of type-1 from the 
Pearson system [5T]. Figure]^ illustrates how the EMD between two ex¬ 
perimental PDFs is computed. The black line in Fig. is the experimental 
CDF of the histogram from panel A, while the grey line is the experimental 
CDF of the histogram from panel B. The EMD{hA,hB) between the two 
velocity profiles is the area between the black and the grey line, which is 
indicated with the light grey shading. We note that the maximum of the 
difference between two CDFs is a basis of the non-parametric goodness-of-fit 
Kolmogorov-Smirnov test m- 

In practice, to compute empirical CDFs we take the cumulative sum of 
histogram bins normalised by the number of data points. We use histograms 
with 101 equidistant bins over fixed range of velocity values (outliers are 
assigned to the most extreme bins). Furthermore, we normalise the EMDs 
with the maximal EMD for a given support Z; since \CDFi{z) — CDF 2 {z)\ < 
1, the maximal EMD is given by the length of the support EMDmax = \Z\. 


Appendix B 

Similarity space 

In Eig. we illustrate properties of the similarity space. Eigure shows 
points corresponding to velocity profiles of solo data from Scenario 1 (x) and 
solo data from Scenario 3 (•). In order to show the points from two different 
experimental set-ups in one plot we normalised position time-series before 
computing velocities. Additionally, since the range of motion in the Scenario 
1 is equal to 60cm and in the Scenario 3 it is equal to 180cm, we multiplied 
normalised position data from the Scenario 1 by 1/3. Insets (al), (a4), 
(a5) and (a7) show examples of velocity profiles from the the experimental 
Scenario 1 and (a2), (a3), (a6) and (a8) show examples of velocity profiles 
from the the experimental Scenario 3. 

Further analysis of the data revealed that the x coordinate of the simi¬ 
larity space is correlated with mean absolute velocity /r|E|, see Fig. |^, and 
that y coordinate of the similarity space is correlated with mean kurtosis of 
normalised velocity segments, see Fig. [^, parts of the velocity time-series 
between two consecutive points of zero velocity. Mean kurtosis of the ve¬ 
locity segments describes how participant is changing direction of motion. 
Low kurtosis indicates sudden changes of directions and relatively constant 
velocity between them, while high kurtosis informs us that the change of 
direction was slow. The two quantities, taken together, explain accurately 
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X ~ mean absolute velocity 



Figure 6: (A) Similarity space showing points corresponding to velocity 
profiles of normalised solo data from the Scenarios 1 (x) and 3 (•). Insets 
(al)~(a8) show examples of the velocity profiles, v is velocity, t is time and T 
indicates normalised duration of the velocity segment. (B) Relation between 
y coordinate of the similarity space and average kurtosis of the velocity seg¬ 
ments: Corr(7/, |u(kurtosis of vel. segments)): R^=0.5657 (pj:j2=0),/9=0.5685 
(pp=0). (C) Relation between x coordinate of the similarity space and av¬ 
erage solo velocity of a participant: Corr(x, y\v\): R^=0.9993 {pr 2 = 0 ), 
p=0.9979 (pp=0). 
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general characteristics of the velocity profiles, e.g. bi-modality of the veloc¬ 
ity profile in the inset (a 6 ) means that the participant was moving with a 
high constant velocity and was quickly changing direction of motion. On 
the other hand, velocity profile in the inset (a3) tells us that the participant 
was changing the direction slowly, high peak close to zero velocity, and was 
reaching maximum velocity only for brief moments. 

More generally. Fig. shows that the dimensions of the similarity space, 
computed using multidimensional scaling of earth’s mover distances between 
velocity profiles, emerge from properties and characteristics of the human 
motion in the mirror game. It is important to note that a single property of 
the velocity profiles, say ij\V\, is not sufficient to separate different partici¬ 
pants. Furthermore, we observe better separation between individuals using 
the coordinates of the similarity space than using a plane defined by their 
correlates. 


Appendix C 

Relative position error 

The Relative position error (RPE) is based on the notion that if two objects 
are moving in the same direction then the one behind is following, and 
on the assumption that changes in direction of movement are initiated by 
the leader. We define the RPE as the difference in the players’ positions 
multiplied by their common direction of motion. In cases when the players 
are moving in opposite directions, we assume that the follower is always 
behind the leader, regardless of the directions of players’ movements. These 
rules lead to the following rule for computing the RPE(xi(t),X 2 (t)): 

f (xi(t) - X 2 (t)) sgn(vi(t)), sgn(vi(t)) = sgn(v 2 (t)) + 0 , 

1 |xi(t) — X 2 (t)|, otherwise. 

Here xi,vi are position and velocity of the leader and X 2 -,V 2 are position 
and velocity of the follower. Positive values of the RPE mean that the 
follower is behind the leader. We note that the RPE is not symmetric, 
that is RPE(xi(t), X 2 (t)) 7 ^ —RPE(x 2 (t), xi(t)) (due to the assumption that 
a follower should react to the action of a leader) and therefore, it could 
be treated as a measure of the performance of the follower in addition to 
indicating the level of temporal correspondence (coordination). 

Figure [^illustrates the ideas behind computing the RPE. Panels Al and 
B1 depict trajectories of movement of two players, leader position is shown 
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Figure 7: Illustration of the principle used for computing relative position 
error. In panels A1 and B1 the black lines indicate leader’s position and the 
grey lines indicate follower’s position. Grey arrows show direction of motion 
of the follower. At the times indicated by double grey-black arrows the par¬ 
ticipants move in opposite directions. Panels A2 and B2 show corresponding 
relative position error (black). Time runs from bottom to top. 


with black line, follower position is shown with grey line; time flows from 
bottom to top. Fig. [7]A2 and B2 show corresponding time series of the 
RPE. Grey arrows indicate the direction of motion of the follower. At the 
times indicated by double grey-black arrows, when the participants move in 
opposite directions, we compute the RPE using the absolute value of the 
difference in position, i.e. we assume that the follower is always behind and 
that the leader initiates changes in the direction of motion. 

Eigure shows how our definition of RPE works for the case when 
the players are often changing direction of motion. In panel A2 we depict 
a follower that is always behind {RPE > 0) and that RPE = 0 occurs at 
times when the players had the same position but were moving in opposite 
directions. Fig. [31 shows that if the follower is ahead of the designated leader 
the RPE is negative. In such a cases we conclude that the designated leader 
was tracking the movement of the designated follower. Grey-black arrows 
in Eig. [331 indicate that in case the designated leader changed direction of 
movement, the RPE changed sign as well. Gomparison of the RPE to other 
measures of coordination can be found in SI appendix. 
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5 Supplementary Information 

5.1 Preprocessing 

• In scenarios 1 and 3, position time series were interpolated with shape¬ 
preserving piecewise cubic interpolation (13Hz in experiment 1 and 
40Hz in scenario 3). 

Matlab command: interpl (t, x, 0 :1/Fs : t (end), 'pchip ' ); Fs is 
the sampling frequency, t is the series of time and x is the position 
time series. 

• In scenarios 2 and 3, the position data was filtered with a zero-phase 
forward and reverse digital 2nd order lowpass (lOHz cut-off) Butter- 
worth filter which is a maximally flat magnitude filter. 

Matlab commands: butter (2,10/(Fs/2) ) and filtfilt. 

• The pre-processed position time series were used to estimate numeri¬ 
cally their corresponding velocity time-series. To differentiate position 
time-series we used a forth-order finite difference scheme. We cut out 
the first and last 2 seconds of the signal. Furthermore, we limit veloc¬ 
ities to 3.5 [a.u./s] in experiment 1 and to 2.7 [m/s] in scenarios 2 and 
3 (higher velocities were considered a results of noise in the collected 
data). 

• To estimate the PDF of the player’s velocity we use normalised his¬ 
togram of the velocity time series with 101 equally distant bins between 
-2.7 and 2.7 [m/s] (or -3.5 and 3.5 [a.u./s] in Experiment 1). 

Supplementary Figure [T] illustrates initial stages of analysis of the data. 
Supp. Supp. Fig.[2a) depicts the representative player’s position collected in 
the solo condition in Scenario 3 and (b) its estimated velocity time-series as 
explained in Methods. For each velocity time-series we compute velocity pro¬ 
file, which is the PDF of the player’s velocity time series. In Supp. Fig. Jud) 
we show the velocity profile of the time series represented in Supp. Fig.I^b). 
We use PDFs of velocity in order to capture the essence of the players’ move¬ 
ment without being affected by the existing physical constraints on their 
motion, e.g. limited position range. Multivariate distributions, involving 
consideration of more than one feature of the motion, would describe the 
dynamics in a more detailed way but we found that univariate distributions, 
namely of player’s velocities Cilia mini El 23 [3] contain enough information 
to achieve the goals of our study. 
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Supplementary Figure 1: (a) An example of solo position time series from the 
Experiment 3. (b) Velocity estimated from position data, (c) Fragment of 
the velocity time series with indicated positive velocity segments (magenta) 
and negative velocity segments (purple), (d) Velocity profile - histogram of 
the velocity time series. 


Finally, Supp. Fig. [^c) depicts the first 20 seconds of the time series 
from Supp. Fig. [^b), with indicated positive velocity segments (magenta) 
for velocities bigger than 0 that correspond to the movements of the hand 
from “left to right”, and negative velocity segments (purple) with veloci¬ 
ties smaller than 0 that correspond to movements from “right to left”. To 
estimate the PDF of the player’s velocity we use normalised histogram of 
the velocity time series with 101 equally distant bins between -2.7 and 2.7 
[m/s] (or -3.5 and 3.5 [a.u./s] in Experiment 1). In Supp. Fig. [^d) we 
show the velocity profile of the time series represented in Supp. Fig. Bb)- 
In order to compare velocity profiles with velocity segments, for each ve¬ 
locity time-series from the experiments 1 and 3 we also find their velocity 
segments. Velocity segments are fragments of the velocity time series be- 
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tween two consecutive points of zero velocity, i.e. each velocity segments 
corresponds to a short movement in one direction. For our analysis, we nor¬ 
malise the velocity segments and compute their curve moments. Following 
(211E3 we take into account only velocity segments that are longer than 0.2 
sec., shorter than 8 sec. and which have displacement larger than 0.03 [m] 
(before normalisation). Note that, for the velocity segments, the moments 
of curve are computed with respect to time and hence parametrise the shape 
of the velocity segments rather than moments of the sample of velocity (see 
Section: Moments of a curve of SI). 

5.2 Earth’s movers distance 

EMD can be computed using the following Matlab code: 


1 

bins=linspace(zl,z2,101); % support Z with 

101 bins 

2 

bin_width=bins(2)-bins(1); % widths of the bins, i.e. dz 

3 

max_emd=abs(z2-zl); 

% maximal EMD 


5 

hl=hist(vl,bins); % 

hi and h2 are velocity 

profiles 

6 

h2=hist(v2,bins); % 

vl and v2 are velocity 

time series 

7 

ll=numel(vl); % 

for normalistion 


8 

12=numel(v2); % 

for normalistion 


9 

erad_vlv2=sum(abs(cumsum(hi/II)-cumsum(h2/12) 

)*bin_width/max_emd 


5.3 Multidimensional scaling 

We use multidimensional scaling (MDS) to study relations between players’ 
velocity profiles. MDS allows us to model the players’ motion as points in an 
abstract geometric space, which we shall refer to as similarity space. It is a 
well established tool in data visualisation and data mining [28] . It allows to 
reduce dimensionality of the data and visualise relations between the objects 
under investigation while preserving as much information as possible. Since 
the EMD is a metric in the space of velocity profiles (defined by the PDFs of 
velocity time series), we use classical MDS as implemented in Matlab. We 
use the Matlab command: cmdscale. 

In particular, we first compute the EMDs between all the analysed PDFs, 
which correspond to individuals’ movements. Then we use the computed 
EMDs in order to construct a matrix D. Each row of this matrix is assigned 
to a different PDF (and hence belongs to a specific individual, i.e. partici¬ 
pant in the mirror game) and contains EMDs between this PDF and all the 
other PDFs. For instance, cell (2,3) contains the EMD between second and 
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third PDFs in our dataset. Since the EMD is a metric, matrix D has zeros 
on the diagonal and is symmetric. 

Next, we use the MDS to transform matrix D into coordinates of points 
in the similarity space. In this way each velocity profile is represented as a 
single point in the similarity space. Here we use only the first two dimensions 
of the similarity space, which were found to be sufficient for the purpose of 
our analysis. These two dimensions correspond to the first two highest 
eigenvalues of matrix D computed in the MDS. 

The MDS algorithm is implemented as follows: 

1. Take n x n matrix D (n number of analysed objects), and square its 
elements in order to obtain matrix D^. 

2. Transform matrix into matrix B; subtract row means, subtract 
column means, add back (grand) mean of all the matrix elements and 
multiply by -0.5. Formally this operation is called double centring and 
can be expressed as: B = —0.5JD^J, here J = I — 1/nll^, where I is 
the identity matrix, 1 is the vector of ones of length n, and 1^ is the 
transposed vector 1. 

3. Factor B by its eigendecomposition B = EAE^, where E is matrix 
which has eigenvectors of B as columns, and A is a diagonal matrix 
with ordered eigenvalues Ai > A 2 > ... > A„ on the diagonal. 

4. Take the first m eigenvectors E^ and eigenvalues Am of matrix B and 

1/2 

compute X = E^Am ; X is a n x m matrix with m coordinates for 
each of the n analysed objects; the MDS relies on the property that 
the eigenvectors of matrix B = XX^ can be interpreted as geometric 
coordinates; X^ is transposed matrix X. 

MDS is a technique related to principal component analysis (PCA) 
[28] . In particular, PCA is a statistical procedure which uses singular value 
decomposition of a matrix Y or eigendecompostion of covariance matrix 
Y^Y /(n — 1) to study underlying structure of the data. Here Y is a cen¬ 
tred (i.e. its columns have removed means) n x m matrix of n observation 
vectors Y. In other words, the PCA uses the eigenvectors of the covariance 
matrix to perform orthonormal transformation of the original coordinate 
system of the data, i.e. it projects the data into an abstract geometric space 
with dimensions given by linear combinations of the the original variables. 
In the same way, the MDS uses eigenvectors and eigenvalues of matrix B to 
find a geometric model of the data in an abstract geometric space. The dif¬ 
ference between PCA and MDS is the origin and nature of the decomposed 
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matrix. The results of both procedures are eigenvectors and eigenvalues 
which can be used to reduce the dimensionality of the data while preserving 
covariance of data (PCA) or preserving distances between analysed objects 
(MDS). In the case in which distances between analysed objects are given 
by covariances, i.e. D = 1 — Y^Y, or if D is given by euclidian distances 
between n observations vectors Y, both methods give the same results. 

The MDS allows us to extend pair-wise analysis of distances between 
velocity profiles and gain further insight into our data p3]. Furthermore, 
using MDS guarantees that the euclidian distances between elements in the 
similarity space are a good approximation of the EMDs between velocity 
profiles. Since EMD is a metric we know that the dynamic similarity between 
players’ movements is reflected in the Euclidean distances between their 
respective positions in the similarity space, i.e. the closer the points in 
similarity space, the more similar their velocity profiles. This renders the 
similarity space a key tool in our analysis of how the dynamic similarity 
affects mutual rapport and coordination between players in the mirror game. 

5.4 Moments of a curve 


Supplementary Table 1; Definitions of the first 4 moments of function 
(curve) f{t) with support/ defined on T=[ti,t 2 ]- 


1st moment — centre of mass 


2nd moment — variance 


3rd moment — skewness 


4th moment — kurtosis 


t2 

IJ‘ = f tf{t)dt 

_ 

a = f(t- p)‘^f{t)dt 
__ 

s = \ Jit- lJ-ffit)dt 

(7 2 ti _ 

k = ^ J{t- n)'^f{t)dt 

^ ti 


To analyse and compare movements of different participants Noy et. al. 
use skewness and kurtosis of normalised velocity segments [ZHEg. To per¬ 
form a meaningful comparison of the moments of different functions f{t), it 

is necessary to rescale their supports T to a common one, and to normalise 

i2 

the functions f{t) with their integrals f f{t)dt. In particular, in [22] as well 

ti 
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Supplementary Figure 2; Different curve segments (a) Normal distribution 
s = 0,k = 3; (b) Minimum jerk s = 0,k = 2.2; {c) s = 0,k = 2; (d) 
s = —0.5, fe = 2.5; (e) s = 0.15,/c = 1.9; (f) s = 0.2, A: = 1.8. For all 
distributions: jjL = 0.5, u = 1. 


as in our analysis the support T of the velocity segments is time normalised 
into r G [0,1]. We note that moments of curve are different from moments 
of a sample, i. e. they are computed with respect to the support, rather that 
the values in the sample. For example, in the case of the centre of mass, the 
area under the curve on the left side of the centre of mass ^ is equal to the 

area under the curve on the right side of it, that is fj,, f f{t)dt = f f{t)dt. 

h IJ- 

Supplementary Figure depicts six examples of normalised curve seg¬ 
ments with support T G [0,1]; all presented functions have the same centre 
of mass /i = 0.5 and variance cr = 1, whilst skewness and kurtosis vary 
between panels. In the case of a velocity segment, skewness indicates asym¬ 
metry in acceleration and deceleration, while kurtosis provides information 
about uniformity of the maximal velocity. Low kurtosis means that an ob¬ 
ject is quickly accelerating and decelerating and keeps constant velocity in 
between while high kurtosis means that the object is accelerating slowly, 
and after reaching maximum velocity it almost immediately starts to slow 
down; normalised velocity segments with higher kurtosis, generally, have 
higher maximum velocity. 
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Supplementary Figure 3: Individual motor signature in A the kurtosis- 
skewness of velocity segments plane |21) and in B the similarity space com¬ 
puted with MDS from distances between velocity profiles. For 15 different 
participants from experimental Scenario 1, on three different days with at 
least one week break between recording rounds. Positive velocity segments 
and velocity profiles from 56 solo trials of 14 participants from experimental 
Scenario 3 shown in C the skewness-kurtosis plane and in D the similarity 
space (for the sake of clarity data for only 14 out of 51 participants is shown). 
Each ellipse corresponds to a different participant. Small dots correspond to 
individual solo recordings. Each cross at the centre of an ellipse corresponds 
to the average of the small dots’ positions. Each ellipse indicates 0.7 mass 
of bivariate normal distribution fitted to the small dots (see SI appendix 
for further details). Box plots in panel E show distributions of overlaps 
CO between pair of ellipses in panels A-D. Line between notches indicates 
median, dot indicates mean. The ’’central box” represents the central 50% 
of the data and its lower and upper boundary lines are at the 25%/75% 
quantile of the data. The two vertical lines extending from the central box 
indicate the remaining data outside the central box that are not regarded as 
outliers, crosses indicate outliers. Panels F~G show examples of overlap uo 
between pair of ellipses: F the ellipses almost completely overlap, a;=0.91; 
G the ellipses partially overlap, ti;=0.13; H the ellipses do not overlap, uj=0. 
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5.5 Comparison of velocity segments and velocity profiles 

In this section we compare two candidates for the individual motor signature. 
Following [21] we begin our analysis by studying kurtosis and skewness of 
velocity segments. Velocity segments, which were used to analyse the mirror 
game in HU [22], are parts of the velocity time series where the participant 
is moving in one direction, i.e., parts of the velocity time-series between two 
consecutive times of zero velocity. From the viewpoint of motion dynamics, 
skewness indicates asymmetry in acceleration and deceleration in a velocity 
segment, while kurtosis provides information about uniformity of the max¬ 
imal velocity in a velocity segment. Low kurtosis indicates that an object 
was quickly accelerating and decelerating, and kept maximal velocity for a 
long time. High kurtosis, on the contrary, means that the object was accel¬ 
erating slowly, and moved with maximal velocity only for a short period of 
time. 

5.5.1 Overlap 

In order to analyse separation and clustering of data points corresponding 
to velocity profiles of individual participants in the similarity space or on 
the plane of skewness and kurtosis of velocity segments, we encircle them 
with ellipses given by bivariate gaussian distribution fitted to their coordi¬ 
nates, and next we compute how much the ellipses overlap. In practice we, 
first, compute mean values and covariance matrix of coordinates of the n 
points which we wish to encircle. The points correspond to n trials of a 
subject. Mean values of the coordinates give the position of the centre of 
the ellipse, while the eigenvectors of the covariance matrix give directions 
of major and minor axes of the ellipse. Finally, the lengths of the axes of a 
covariance ellipse that encloses the desired probability mass are given by the 
square roots of the eigenvalues of the covariance matrix multiplied by the 
Mahalanobis radius [53] . In our analysis we use a radius that encloses all of 
the data points of a participant, which corresponds to 0.7 of the probability 
mass of the bivariate normal distribution. 

We compute the overlap, a;, between ellipses as a ratio of the area of 
intersection and the total area of two ellipses. In this way total separation 
corresponds to no overlap a; = 0, whilst complete overlap a; = 1 means that 
we cannot distinguish between the two ellipses and hence we cannot distin¬ 
guish between points that are encircled by them. The overlap oj between 
ellipses allows to assess clustering and separation between regions of the 
similarity space, or the plane of skewness and kurtosis of velocity segments, 
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corresponding to different individuals. The advantage of this simple method 
is that it is dimension independent and hence allows to compare clustering 
and overlap in different spaces. 

5.5.2 Comparison 

Supplementary Figure depicts velocity prohles of individual players pre¬ 
sented as elements of the similarity space. Supplementary Figure clearly 
demonstrates that the median overlap oj between ellipses, and hence indi¬ 
viduals, in the skewness-kurtosis plane uja = 0.2 is much higher than the 
median overlap between ellipses in the similarity space ojb = 0.02 (signifi¬ 
cance < 0.0001, Kolmogorov-Smirnov test [SnillS]). More importantly, 
there are 45 out of 105 pairs of ellipses that do not overlap at all in the simi¬ 
larity space while in the kurtosis-skewness plane all pairs of ellipses overlap, 
(mincuyi = 0.004). To verify our results we also analyse solo recordings 
collected in the experimental Scenario 3. In the experimental Scenario 3, 
players had larger range of movement and all the solo trials of individual 
players were recorded on a single day. Nevertheless in this case we also find 
that the median overlap a) between ellipses in the skewness-kurtosis plane 
uc = 0.1 is much higher than the median overlap between ellipses in the 
similarity space ujd = 0.05 (significance pcD < 0.0001) and the number of 
non-overlapping pairs of ellipses is higher in the similarity space (418 against 
183 out of 1378 pairs); see Supp. Fig. and D. In both experimental sce¬ 
narios, we observe that separation between ellipses, and hence individuals, 
is significantly better in the similarity space. 

Our analysis reveals that, despite being a good source of information 
about human movement on a short time-scale (rates of acceleration, uni¬ 
formity of maximal velocity), velocity segments are not specific enough to 
study the effects of dynamic similarity between individual players. More 
specifically, we find that although the mean values of kurtosis and skewness 
of velocity segments exhibit clustering for each person, and that the clus¬ 
ters are preserved over time, there also exists a big overlap between mean 
skewness and kurtosis of different players, meaning that it is not possible to 
distinguish between them; see Supp. Fig. [^, C and E. 


30 


Dyad 1 


Dyad 2 


Dyad 3 


Dyad 4 


>' 

o 

"§ 0 
o 


o 

n 

CO 0 
CD 





'\s 

1 




L2(^ 


\s 

1 


Q. 

E 



o 

0 
CO 
CD 


■a 0 

CO 

CD 





Dyad 6 







0 

F2 





L1 S1 

S2[f’ O 

•'Ll 



uV 

S2 


0 

^2 S1 

0 

0 


0 

0 


0 

SI 

S2 

0 






Fli\S2 O 

d " 




."X 



si 

u 

L2^F1 

0 


0 

0 


0 

JI2 

■fe? SI 

S2 

0 






1? 

0 

JI1 

0 

-X 


X 0 


0 X 


0 X 


Supplementary Figure 4: Interaction between two players in different exper¬ 
imental conditions (Scenario 2) visualised in the similarity space for all 8 
dyads. Ellipses encircle points corresponding to velocity profiles in solo (SI 
and S2; red), leader (LI and L2; black), follower (FI and F2; green) and 
joint improvisation (JIl and JI2; blue) rounds. Each column depicts data 
for two different dyads, x and y axis are rescaled for clarity of presentation. 
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Supplementary Figure 5: Kurtosis and skewness for velocity segments from 
time series recorded in the experiment. In panel (a) values from positive 
velocity segments, in (b) from negative velocity segments; compare with 
Supp. Fig. [^c). In black skewness and kurtosis of velocity segments from 
ICA acting as a leader. In blue skewness and kurtosis of velocity segments 
from human players acting as a leader. In red skewness and kurtosis of ve¬ 
locity segments from human players in solo conditions. Yellow star indicates 
point with k = 2.2 and s = 0 which corresponds to the smoothest movement 
|21j . Dash-dotted line shows theoretical bound given by relation between 
kurtosis and skewness of a curve k < ,s'^ + 1 [55]. 

5.6 Velocity segments of movement generated by ICA 

In this section we use kurtosis and skewness of velocity segments to show 
that the trajectories generated by the ICA IMIEZ] in Scenario 3, have the 
features of a human movement. In our analysis we compared skewness and 
kurtosis of: velocity segments of human solo movement, velocity segments 
of human leader movements, and velocity segments of motion generated by 
the ICA as a leader. We found that except for few outliers, the velocity 
segments generated by the ICA have the same kurtosis and skewness as the 
one observed in human motion. 

Supplementary Figure shows kurtosis and skewness of velocity seg¬ 
ments from time series recorded in experiment 3, (a) for positive veloc¬ 
ity segments and (b) for negative velocity segments. Corresponding to the 
movement of the hand towards and away from the centre of the body, respec¬ 
tively. The skewness and kurtosis of velocity segments from human solo is 
depicted in red, human leader in blue and avatar leader in black. We notice 
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that for some points the skewness of the avatar leader (black) have bigger 
values than typical human leader (blue), this is due to the fact that, while 
leading the human follower, the avatar was at the same time tracking the 
fast changing pre-recorded reference trajectory. In other words, the stronger 
skewness indicates that the avatar was quickly accelerating to match the pre¬ 
recorded position and then slowly decelerating to allow human follower to 
catch up. Nevertheless, overall the black dots and blue circles occupy a 
similar region of the kurtosis-skewness plane. In both panels all the veloc¬ 
ity segments are centred on the point with skewness s = 0, and kurtosis 
k = 2.2, which is indicated by a cyan star. This point corresponds to the 
velocity segment with the smoothest movement as reported in [HIES]. Nor¬ 
mal distribution has skewness s = 0, and kurtosis k = 3. Dash-dotted line 
shows theoretical bound of the values of skewness and kurtosis given by the 
theoretical relation between them k < s'^ + 1 [55]. 


Supplementary Table 2: Skewness of positive and negative s_ velocity 
segments from different movement recordings: S - human solo movement, 
Lh - human leader. Fa - avatar follower. La - avatar leader, Fh - human 
follower, pf^s is significance level of Kolmogorov-Smirnov test. 



S+ 

S- 

p-value 

s 

0.0098 

0.0489 

Pfcs=9.5e-4 

Lh 

-0.0070 

0.0291 

Pks <0.0001 

La 

0.0473 

0.1320 

Pks <0.0001 

Fh 

0.0913 

0.0658 

Pks=7.8e-4 


In Supplementary Table we report the difference in skewness of the 
positive and negative velocity segments. This difference is a result of asym¬ 
metry in the movement of the hand towards and away from the centre of the 
body, i.e., the movement is actuated by different groups of muscles [37]. We 
have not found difference between kurtosis of positive and negative velocity 
segments in any condition. 

In summary, Supp. Fig. [^ shows that in most trials, velocity segments 
of the avatar leader (driven by ICA) have kurtosis and skewness which are 
very similar to the human players. Furthermore, higher than in Solo condi¬ 
tion values of skewness of the human follower’s velocity segments are con¬ 
sistent with the observation that after noticing changes of direction of the 
leader’s movement, the human follower reacts and accelerates quickly to 
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correct her/his position. Next, she/ he slows down to track the leader’s 
movement in a more precise way. 

5.7 Correlations and partial correlations between different 
variables and RPE 


Supplementary Table 3: Partial correlations between RPE and EMD con¬ 
trolled for and RPE and average absolute velocity of the leader ^\Vi\ 

controlled for EMD in data from scenario 2 and scenario 3. 


Scenario 2: 


EMD{Si,S2) 

RPE{L,F) 

p=0.3448 (pp=0.0189) 

/9=0.3466 (pp=0.0183) 

Scenario 3: 

pIVlypI 

EMD{Ref, S) 

RPE{Lvp, Eh) 

p=0.6554 ipp=0) 

/9=0.1863 (pp=0.4e-05) 


Considering the characteristics of motion, the effect of adding a 2.5Hz 
sinusoidal signal to the solo trajectories results in higher average absolute ve¬ 
locity of the reference trajectory: R‘^{^EMD{Ref, 5), /i| VRe/|—/r| Vs'|)=0.9676 
(p = 0), Spearman’s p{fiEMD{Ref, S), fj,\Vjief\ — /i| V5|)=0.9689 (p = 0). 
Nevertheless, we still found significant effect of the dynamic similarity con¬ 
trolled for average absolute velocity of the leader, see Supplemetary table 
Scenario 3. The existence of this correlation confirms that the velocity of 
the leader’s motion alone could no explain the variability in the RPE, even 
in the very limited case when dynamic similarity simplifies to differences 
between preferred (solo) velocities of the players. 
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Supplementary Table 4: Correlations between RPE and different measures 
of similarity between solo recordings. Relation between data is measured 
with Pearson B? and Spearman’s rank correlation coefficient p. ^|Vs. | is 
average absolute solo velocity, max | Vs- \ is maximum absolute solo velocity, 
sks- is mean skewness of the solo velocity segments, krs- is mean kurtosis 
of the solo velocity segments, {sk,kr)s- are the coordinates of a centre of 
player’s ellipse in the skewness-kurtosis plane obtained from the solo trials. 



pRPE{L, E) 

p.RPE{Lvp, Eh) 

EMD{Sl,Sf) 

R^=0.3701 
(Pr2 =0.0105) 
/)=0.3907 

(Pp=0.0066) 

R^=0.2343 

(PR2=4.5e-09) 

/)=0.2224 

(pp=2.7e-08) 

ahs{p\VsL\ - k'lVsrl) 

R^=0.3469 
(Pk 2 =0.0169) 
/)=0.3453 
(Pp=0.0175) 

R^=0.3281 

(Pi?2=8.0e-17) 

/)=0.2997 

(Pp=3.6e-14) 

abs(max — max Vsi? ) 

R^=0.1110 
(p^2 =0.4576) 
/9=0.1383 
(pp=0.3538) 

R^=0.1154 
(p^2 =0.0043) 
/)=0.0824 
(j9p=0.0415) 

ahs{sksL - sksp) 

R^=0.3834 
(Pk 2 =0.0078) 
/9=0.3152 
(pp=0.0309) 

R^=0.2124 
(Pi?2=l .16-07) 
/3=0.1427 
(pp=4.0e-04) 

ahs{krsL — krsp) 

R^=0.0686 
(p^2 =0.6468) 
p=0.1405 
(Pp=0.3461) 

R^=-0.2271 

(Pi?2=1.3e-08) 

p=-0.2287 

(pp=1.0e-08) 

\\{sk,kr)sL - {sk,kr)sF\\2 

R^=0.1058 
(Pk 2 =0.4791) 
p=0.2132 
(Pp=0.1501) 

R^=-0.1346 

(Pi?2=8.4e-04) 

p=-0.0835 

(pp=0.0389) 
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5.8 Statistical tests 


Since our data is not normally distributed, to test the existence of corre¬ 
lations we use Spearman’s rank correlation coefficient p [l3]. Additionally, 
for illustrative purposes, we compute the Pearson E? coefficient of linear de- 
pendance. To compute correlation coefficients and their significance values 
(p-values) we use Matlab commands: 

[R2, p]=corr (x, y, 'type' , 'Pearson ' ) and 
[rho,p]=corr (x, y, ' type' , 'Spearman' ) . 

For the same reason, to test statistical significance of differences between 
distributions we use Kolmogorov-Smirnov test computed with Matlab com¬ 
mand kstest2. Kolmogorov-Smirnov test determines whether independent 
random samples are drawn from the same underlying continuous population 

m- 


5.9 Relative phase 

Analysis of the relative phase between two (or more) oscillators is an es¬ 
tablished method for quantifying synchronisation (coordination) level and 
hence temporal correspondence between periodic time series |44[ 156] . We 
performed such analysis by using a method of reconstructing phase of an 
oscillator from data as described in [52l|57]. In particular, following [52], we 
computed protophase using the Hilbert transform and transformed it into 
phase, which grows linearly with time, using the Damoco 2 toolbox for Mat¬ 
lab |SH|- However, measures of temporal correspondence that rely on the 
relative phase based on the Hilbert transform are not suited for the analysis 
of the time series recorded in our experiments for the following reasons: 

• they have non-zero local mean; signal with moving averages have big 
jumps in phases which introduce big errors in relative phase (see Fig. 2 
in jlH), 

• their amplitude and phase spectra are not well separated; relative 
phase is sensitive to changes of amplitude, 

• in many cases the time series contain multiple frequencies; instanta¬ 
neous phase based on the Hilbert transform can be computed but does 
not have a physical interpretation. 

More information about issues stated in the above list and importance of 
different assumptions for correct estimation of the phase of a signal can be 
found in |44j . 
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Since the results obtained from the analysis of relative phase based on 
Hilbert transform were not satisfactory, we decided to use a method of es¬ 
timating the relative phase based on a wavelet transform of a time series 
[mugED]. In particular, we used estimation of relative phase based on 
wavelet coherence as described in [l8| and implemented in Crosswavelet and 
Wavelet Coherence toolbox for Matlab |59j . Wavelet coherence can be con¬ 
sidered a localised correlation coefficient in time-frequency space. 

Wavelet coherence provided us with an estimate of relative phase in the 
time-frequency space, i.e. at each time we have multiple values of relative 
phase that correspond to different frequencies. To reduce dimensionality 
of the time frequency estimate of the relative phase, we averaged it over 
frequencies, obtaining in this way the time course of relative phase. 

Supplementary Figure [^illustrates the process of averaging the estimate 
of the relative phase computed in the time-frequency space over frequency. 
In particular, Supp. Fig.j^a) shows the position time series of leader (black) 
and follower (green), while Supp. Fig. j^bl) shows the values of the wavelet 
coherence in the time-frequency space. Red colours indicate high coherence, 
i.e. the two signals have correlated frequency components at a given time, 
whilst blue ones indicate regions with no coherence. Black contour delin¬ 
eates the area where common frequencies of both signals are statistically 
significant; tested against random noise |48] . Arrows are a visualisation 
of the phase relation between correlated frequency components of the two 
time series (clockwise angles have negative values, anti-clockwise angles have 
positive values). Arrows pointing to the right show that the two signals are 
in-phase. For clarity only arrows in the regions with statistically significant 
coherence are shown. 

Supp. Fig. §b2) shows frequency average of relative phase from 
the regions with statistically significant coherence; we use circular mean to 
compute the average [l6]. Supp. Fig. j^c) shows the relative phase based 
on the Hilbert transform (pp^t computed with the Damoco 2 toolbox |59j : 
multiple jumps in the relative phase are caused by the changes in the local 
means of the two signals. This figure clearly demonstrates that the estimate 
of the relative phase computed with wavelet coherence (pw is better than 
the one based on Hilbert transform (jiprt, since the sign of the former is 
consistent with the fact that the designated leader was actually leading 
the other player during the joint action. The advantage of this method 
originates from the fact that (/>w is based on the parts of the signal which 
are measurably correlated and can be modelled with periodic functions in 
the time-frequency plane. 
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0.72 




Supplementary Figure 6: Relation between wavelet coherence and relative 
phase, (a) Position time series of leader (black) and follower (green), (bl) 
Squared wavelet coherence between leader and follower time series, red in¬ 
dicates high coherence and blue low coherence. Black contour shows 0.05 
significance level, arrows indicate relative phase relationship (clockwise pos¬ 
itive values, anti-clockwise negative values). (b2) Relative phase computed 
with significant wavelet coherence averaged over frequencies, (c) Relative 
phase between time series based on Hilbert transform. 
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Supplementary Figure 7: Comparison of relative position error and relative 
phase computed with wavelet coherence, (a) position time series of leader 
(black) and follower (green), (b) Relative position error, (c) Relative phase 
computed with wavelet coherence (j)w- 


5.10 Comparison of different measures of temporal corre¬ 
spondence 

Having introduced different measures of temporal correspondence in the 
sections above we now compare the relative error in position and the estimate 
of the relative phase based on wavelet coherence, using data from experiment 
3 (we used data from experiment 3 because it contains the largest number 
of trials). 

Supplementary Figure [^a) shows position time series of leader (black) 
and follower (green) (the plots do not start from zero because we cut out the 
first 2 seconds of the signals). Supp. Fig. ^b) shows the RPE between the 
positions in panel (a), while Supp. Fig. [7 c) shows the estimate of relative 
phase based on the wavelets coherence. We observe in Supp. Fig.j^b) and (c) 
that the RPE behaves differently compared to the relative phase, e.g. in 
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the time interval [10,15] the RPE indicates that the follower is ahead of the 
leader {RPE < 0), while the relative phase shows that there was no exchange 
of roles between leader and follower. This different behaviour is caused by 
the fact that the RPE is computed using the information at a given instant 
of time, while the estimate of the relative phase is based on the wavelet 
transformation for which time localisation depends on the frequency and is 
limited by the time-frequency uncertainty principle |48j . Also, in this time 
interval there are no fast oscillations in the movement, therefore the phase 
was estimated using low frequency wavelets for which the relative phase was 
positive (compare with Supp. Fig. j^b)). 

The negative value of the relative phase in Supp. Fig.j^c) around t = 17s 
is caused by the temporal mismatch between the minimum in the follower’s 
trajectory (green) and the next minimum on the leader’s trajectory (black). 
The minimum in the leader’s trajectory indicated by the vertical dotted line 
in panel (a) occurs after the green one, while all the other extrema of the 
black trace precede the green trace extrema. The relatively fast change in 
trajectory in this case was estimated by using higher frequency wavelet of 
short duration for which the relative phase was negative. Observations from 
Supp. Fig.j^c) are consistent with the RPE in panel (b) which has negative 
values for a short time around t = 17s. 

More generally, based on our analysis and the example discussed above, 
we conclude that in the context of the mirror game, where the players 
move along complicated trajectories, the most useful method for quantifica¬ 
tion and assessment of the leader-follower interaction is the RPE measure. 
Specifically, the RPE exhibits stronger association to the dynamics of the 
movement (in terms of statistical significance of the results of the analysis), 
than the relative phase. Nevertheless, we envisage that the relative phase 
based on wavelet coherence would be useful when analysing data from the 
mirror game played in a condition without designated leader, e.g. joint im¬ 
provisation, when the RPE cannot be used. Finally, an advantage of using 
the RPE to quantify temporal correspondence is its straightforward physical 
interpretation. 

5.11 On the relation between temporal correspondence and 
dynamic similarity 

Given two complex time-series, regardless of their origin, it is always possible 
to measure their temporal correspondence, e.g. using relative position error 
(RPE), as well as compute their dynamic similarity, using earth’s mover 
distance (EMD) between histograms of their first derivative. By comparing 
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time [s] 


velocity [m/s] velocity [m/s] 


Supplementary Figure 8 : Top row shows an example of nontrivial dynamic 
similarity: panel A1 shows two solo movement trajectories of the same par¬ 
ticipant, corresponding velocity profiles are shown in panels A 2 and A3; 
i?PFl^i=0.19, EMD{hA2,hA:i)=0.009. Bottom row shows an example of 
trivial dynamic similarity: panel B1 shows movement trajectories of a leader 
(black) and a follower (grey), corresponding velocity profiles are shown in 
panels B2 and B3; RPEbi= 0-008, EMD{hB2,hB3)=0-008. 


these two quantities, we can define trivial and nontrivial dynamic similarity. 

More specifically, if the two position time series are coordinated, they 
will necessarily have similar velocity profiles. For example, consider perfect 
synchronisation when two time series are identical, in such case also their 
velocity profiles have to be identical and the EMD between them equals 0, 
i.e. good coordination small EMD. Dynamic similarity, which is a result 
of the synchronisation between time series, shall be called trivial. On the 
other hand, if the EMD between velocity profiles is small, while position 
time series are uncoordinated we observe nontrivial dynamic similarity i.e. 
small EMD 7 ^ high coordination. Such situation is possible because velocity 
profiles do not contain temporal information. 

Supplementary Figure illustrates the difference between trivial and 
nontrivial dynamic similarity. In panel A we depict two trajectories of 
solo movement of a player and their corresponding velocity profiles. The 
mean RPE between the two trajectories in panel A1 is equal to hRPEai = 
0.19, and the EMD between histograms in panels A2 and A3 is equal 
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EMD{hA 2 ,hA 3 ) = 0.009; it is an example of nontrivial dynamic similar¬ 
ity. In panel B we depict leader (black) and follower (grey) trajectories 
and their corresponding velocity profiles. Here: RPEbi = 0.008, and 
EMD{hB 2 ,hB 3 ) = 0.008; panel B shows example of trivial dynamic simi¬ 
larity. 


References 

[1] Schmidt, R.C., Richardson, M.J.: (2008) Coordination: Neural, behav¬ 
ioral and social dynamics. In: Coordination: Neural, behavioral and 
social dynamics. Springer: 281-308. 

[2] Hogan, N., Flash, T.: (1987) Moving gracefully: quantitative theories 
of motor coordination. Trends in Neurosciences 10:170-174. 

[3] Viviani, P., Flash, T.: (1995). Minimum-jerk, two-thirds power law, and 
isochrony: converging approaches to movement planning. Journal of 
Experimental Psychology: Human Perception and Performance, 21(1), 
32. 

[4] Hogan, N., Sternad, D.: (2007) On rhythmic and discrete movements: 
reflections, definitions and implications for motor control. Exp Brain 
Res 181:13-30. 

[5] Kilner, J.M., Paulignan, Y., Blakemore, S.J.: (2003). An Interference 
Effect of Observed Biological Movement on Action. Current Biology, 
13(6), 522-525 

[6] Kilner, J., Hamilton, A. E. d. C., Blakemore, S.J.: (2007). Interference 
effect of observed human movement on action is due to velocity profile 
of biological motion. Social Neuroscience, 2(3-4), 158-166. 

[7] Folkes V.S.: (1982) Forming relationships and the matching hypothesis. 
Personality and Social Psychology Bulletin, 8 (4):631-636. 

[8] Marsh, K.L., Richardson, M. J., Schmidt, R.: (2009) Social connection 
through joint action and interpersonal coordination. Topics in Cognitive 
Science, 1(2), 320-339. 

[9] Lakens, D., Stel, M.: (2011) If they move in sync, they must feel in sync: 
Movement synchrony leads to attributions of rapport and entitativity. 
Social Cognition, 29(1): 1-14. 


42 



[10] Oullier, O., De Guzman, G. G., Jantzen, K. J., Lagarde, J., Kelso, J. S.: 
(2008) Social coordination dynamics: Measuring human bonding. So¬ 
cial neuroscience, 3(2): 178-192. 

[11] Schmidt, R.G., Nie L., Franco A., Richardson, M.J.: (2014) Bodily 
synchronization underlying joke telling. Front. Hum. Neurosci. 8:633. 
doi: 10.3389/fnhum.2014.00633 

[12] Pinel, E. G., Long, A. E., Landau, M. J., Alexander, K., Pyszczyn- 
ski, T.: (2006) Seeing I to 1: a pathway to interpersonal connectedness. 
Journal of Personality and Social Psychology, 90(2), 243. 

[13] Bardy, B. G., Salesse, R. N., Gueugnon, M., Zhao Zhong, Lagarde, J., 
Marin, L.: (2014) Movement similarities and differences during social 
interaction. IEEE International Conference on Systems, Man and Cy¬ 
bernetics (SMC), 772-777. 

[14] Zhao, Z., Salesse, R. N., Gueugnon, M., Schmidt, R. C., Marin, L., 
Bardy, B. G.: (2015) Moving attractive virtual agent improves inter¬ 
personal coordination stability. Human Movement Science, 41, 240-254. 

[15] Qin, J., O’Meara, B., McEachern S.: (2009) The need for an integrated 
theoretical framework for researching the influence of group diversity 
on performance. Management Research News, vol. 32, pp. 739-750. 

[16] von Holst, E.: (1973) The behavioral physiology of animal and man. 
Coral Gables, EL: University of Miami Press. (Original work published 
1939) 

[17] Rosenblum, L. D., Turvey, M.: (1988) Maintenance tendency in co¬ 
ordinated rhythmic movements: Relative fluctuations and phase. Neu¬ 
roscience, 27(1), 289-300. 

[18] Schmidt, R. C., Turvey, M. T.: (1994) Phase-entrainment dynamics 
of visually coupled rhythmic movements. Biological Cybernetics, 70(4), 
369-376. 

[19] Zanone, P-G., Kelso J.A.S.: (1992) Evolution of behavioral attractors 
with learning: Nonequilibrium phase transitions. Journal of Experi¬ 
mental Psychology: Human Perception and Performance, Vol 18(2), 
403-421. http://dx.doi.Org/10.1037/0096-1523.18.2.403 


43 



[20] Kostrubiec, V., Zanone, P-G., Fuchs, A., Kelso J.A.S.: (2012) Be¬ 
yond the blank slate; routes to learning new coordination patterns de¬ 
pend on the intrinsic dynamics of the learner —experimental evidence 
and theoretical model. Front. Hum. Neurosci. 6:222. doi: 10.3389/fn- 
hum.2012.00222 

[21] Hart, Y., Noy L., Feniger-Schaal R., Mayo A.E., Alon U.: (2014) In¬ 
dividuality and Togetherness in Joint Improvised Motion. PLoS ONE 
9(2): e87213. doi:10.1371/journal.pone.0087213 

[22] Noy, L., Dekel, E., Alon, U.: (2011) The Mirror Game as a Paradigm for 
Studying the Dynamics of Two People Improvising Motion Together. 
Proc Natl Acad Sci USA 108:20947-20952. 

[23] Slowinski, P., Rooke, E., di Bernardo, M., Tsaneva-Atanasova, K.: 
(2014) Kinematic characteristics of motion in the mirror game. IEEE 
International Conference on Systems, Man and Cybernetics, 748-753. 

[24] Kullback, S., and Richard A. L.: (1951) On information and suffi¬ 
ciency. The annals of mathematical statistics 22(l):79-86. 

[25] Cohen, S., Guibas, L.: (1997) The earth mover’s distance: Lower 
bounds and invariance under translation. DTIC Document, Tech. Rep. 

[26] Levina, E., Bickel, P.: (2001)The earth mover’s distance is the mallows 
distance: some insights from statistics. 2001 Eighth IEEE International 
Conference on Computer Vision, ICCV 2001 Proceedings vol. 2, 251- 
256. 

[27] Muskulus, M., Verduyn-Lunel, S.: (2011) Wasserstein distances in the 
analysis of time series and dynamical systems. Physica D: Nonlinear 
Phenomena, Vol 240(1), 45-58. 

[28] Borg, L, Groenen, P.J.P.: (2005) Modern Multidimensional Scaling: 
Theory and Applications. Springer Series in Statistics 2nd ed. 2005, 
614 p. 

[29] Noy, L., Alon, U., Friedman, J.: (2015) Corrective jitter motion shows 
similar individual frequencies for the arm and the finger. Experimental 
Brain Research, doi: 10.1007/s00221-015-4204-l 

[30] Chakravarty, 1. M., Roy, J. D., and Laha, R. G.:(1967). Handbook 
of Methods of Applied Statistics, Volume I, John Wiley and Sons, pp. 
392-394. 


44 



[31] Noy, L., Binnun, N.L, Alon, U., Golland, Y.: (2015) Being in the zone: 
physiological markers of togetherness in joint improvisation. Front. 
Hum. Neurosci, doi: 10.3389/fnhum.2015.00187 

[32] Hogg, R. V., McKean, J., Craig, A. T.: (2005). Introduction to 
mathematical statistics. Pearson Education. 

[33] Issartel, J., Marin, L., and Cadopi, M.: Unintended interpersonal co¬ 
ordination: “can we march to the heat of our own drum?”. Neuroscience 
Letters 411, pp. 174-179 (2007) 

[34] (2015, March). [Online]. Available: 

[35] (2015, March). [Online]. Available: 

[36] Zhai, C., Alderisio, F., Tsaneva-Atanasova, K., di Bernardo, M.: (2014) 
Adaptive Tracking Control of a Virtual Player in the Mirror Game. 
Proceedings of IEEE Conference on Decision and Control (CDC), 7005- 
7010 

[37] Zhai, C., Alderisio, F., Tsaneva-Atanasova, K., di Bernardo, M.: (2014) 
A novel cognitive architecture for a human-like virtual player in the mir¬ 
ror game. Proceedings of IEEE International Conference on Systems, 
Man and Cybernetics (SMC), 754-759. 

[38] Kantorovich, L.V., Rubinstein, G.Sh.: (1958) On a space of completely 
additive functions (in Russian). Vestnik Leningrad Univ. 13(7), 52-59. 

[39] Varlet, M., Coey, C. A., Schmidt, R. C., Marin, L., Bardy, B. G., 

Richardson, M. J.: (2014) Influence of stimulus velocity profile on 

rhythmic visuomotor coordination. J Exp Psychol Hum Percept Per¬ 
form, 40(5), 1849-1860 

[40] Kelso, J. S., de Guzman, G. C., Reveley, C., Tognoli, E.: (2009). Virtual 
partner interaction (VPI): exploring novel behaviors via coordination 
dynamics. PLoS One, 4(6), e5749. 

[41] Dumas, G., de Guzman, G. C., Tognoli, E., Kelso, J. S.: (2014). The 
human dynamic clamp as a paradigm for social interaction. Proceedings 
of the National Academy of Sciences, 111(35), E3726-E3734. 

[42] Billingsley, P.: Probability and Measure, Anniversary Edition. John 
Wiley and Sons, (2012) 


http://www.euromov.eu/alterego/ 
http://www.leapmotion.com 


45 


[43] Corder, G.W., Foreman, D.I.: (2014). Nonparametric Statistics: A 
Step-by-Step Approach. 2nd edition, Wiley. 

[44] Equis, S., Jacquot, P.: (2010) Phase Extraction in Dynamic Speckle 
Interferometry with Empirical Mode Decomposition and Hilbert Trans¬ 
form, Strain 46, 550-558 

[45] Fink, W.P., Kelso, S.J.A., Jirsa, V.K., de Guzman, G.; (2000) Re¬ 
cruitment of degrees of freedom stabilizes coordination. Journal of Ex¬ 
perimental Psychology: Human Perception and Performance, 26(2), 
671-692. 

[46] Pisher, N.I.: (1995) Statistical Analysis of Circular Data. Cambridge 
Univeristy Press, Cambridge, UK 

[47] Plash, T., Hogan, N.: (1985) The coordination of arm movements: an 
experimentally conhrmed mathematical model. J Neurosci 5:1688-1703. 

[48] Grinsted, A, Moore, J.C., Jevrejeva, S.: (2004) Application of the cross 
wavelet transform and wavelet coherence to geophysical time series. 
Nonlinear Processes in Geophysics 11, 561-566 

[49] Issartel, J., Marin, L., Gaillot, P., Bardainne, T., Cadopi, M.: (2006). 
A practical guide on time-frequency analysis to study human motor 
behavior: the contribution of wavelet transform. J. Mot. Behav. 38, 
139-159. 

[50] Issartel, J., Bardainne, T., Gaillot P., Marin L.: (2015) The relevance 
of the cross-wavelet transform in the analysis of human interaction: a 
tutorial. Front. Psychol. 5:1566. 

[51] Johnson, N.L., Kotz, S., Balakrishnan, N.: (1994) Continuous Univari¬ 
ate Distributions, Volume 1, Wiley-Interscience. 

[52] Kralemann, B., Cimponeriu, L., Rosenblum, M., Pikovsky, A., 
Mrowka, R.: (2008) Phase dynamics of coupled oscillators reconstructed 
from data. Physical Review E, 77(6), 066205. 

[53] Manly, B.P.: (2004) Multivariate statistical methods: a primer. CRC 
Press. 

[54] Herbert-Read, J.E., Krause, S., Morrell, L.J., Schaerf, T.M., Krause, J., 
Ward, A.J.W.: (2013) The role of individuality in collective group 
movement. Proc R Soc B 280: 20122564. 


46 



[55] Pearson, K.: (1929) Editorial note to “Inequalities for moments of fre¬ 
quency functions and for various statistical constants”. Biometrika 21 
(1-4), 370-375. doi:10.1093/biomet/21.1-4.361. 

[56] Varlet, M., Richardson, M.J.: (2011) Computation of continuous rela¬ 
tive phase and modulation of frequency of human movement. Journal 
of biomechanics, 44(6), 1200-1204. 

[57] Revzen, S., Guckenheimer, J.M.: (2008) Estimating the phase of syn¬ 
chronized oscillators. Physical Review E 78, 051907. 

[58] (2015, March). [Online]. Available: http://www.stat.physik.uni- 
potsdam.de/~mros/damoco2.html 

[59] (2015, March). [Online]. Available: http://www.glaciology.net/wavelet- 
coherence 


47 





